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Feedback  for  2010  EDQM  Workshop 


•  More  focus  on  case  studies...  Less  theory... 

•  There  seemed  to  be  a  lot  more... statistics... Too 
much  theory... 

•  Similar  comments  for  2009  Workshop 

...  Thomas  Georgian  -  great  presenter!  ALMOST 
made  me  want  to  be  a  statistician,  then  I  regained  my 
senses. 
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Warning  ! 

The  following  presentation  contains  information  of 
a  factual  nature  and  mature  technical  content  that 
may  not  be  suitable  for  all  audiences.  If  you  are 
easily  disturbed  by  use  of  strong  scientific 
language,  excessive  mathematics,  or  graphic 
uncensored  data  of  an  explicitly  statistical  nature, 
viewer  discretion  is  strongly  advised. 


Probabilistic  evaluations  and 
Gy’s  sampling  theory  used 
extensively. 
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Case  Study  Site  Investigation  (SI)  of  “Site  X” 

•  20,000-acre  site  with  multiple  skeet  &  small  arms  ranges. 

•  Stratified  into  %-acre  Sampling  Units  (SUs)  with  highest 
suspected  levels  of  contamination. 

•  2-kg  incremental  samples  (IS)  of  100  increments  from 
surface  soils  (0-2  inches  )  tested  for  metals  (e.g.,  Cu,  Pb, 
Zn  &  Sb)  by  Method  601  OB,  as  well  as  PAHs  by  8270C-SIM 
and  explosives  by  8330B. 


•  Splits  of  unground  &  ground  lab  sub-samples  (steel  puck 
mill  in  Method  8330B)  analyzed. 


4 


BUILDING  STRONG, 


Site  X  Boundary, 


_ 

29  SUs  &  65  IS 


Range 

Complex 

MRS05 


um  woo  o 
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Replicate  IS  Samples  (Unground) 
from  SU  with  Small  Arms  Berm 


IS  Field  Replicates  (mg/kg) 

Mean 

Metal 

n  =  l  (MRS05,  SU#5) 

(mg/kg)  %RSD 

Pb 

170 

200 

660 

240 

160 

130 

380 

277 

68% 

Cu 

40 

50 

51 

72 

31 

34 

53 

47 

29% 

Pb  Screening  Limit  (SL)  =  400  mg/kg. 

Pb  Concentrations  (x) «  100  -  700  mg/kg. 

%RSD  >  30%  Distribution  not  normal  (but  lognormal) 

Are  data  usable  to  determine  if  site  is  “clean” 
or  “dirty”? _ 
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Evaluating  RSDs  >  30% 

•  Work  Plan: 

Provided... the  calculated  RSD  is  lower  than  the  stated  RSD 
[<  20  for  lab  triplicates,  <  30  for  field  replicates]...  the 
samples... can  be  reasonably  assumed  to  be  representative  of 
the  site  conditions... 

•  Post-sampling:  %RSD  =  100%  -  200%  for  replicates. 

Excerpt  from  contractor’s  tech  memo:  Whether  [large  %RSDs 
are]  ...appropriate... depends  on... how  close  to  a  decision 
limit  a  concentration  result  might  be.  It  does  not 
mean. ..data  should  be  automatically  rejected  if  the  %RSD 
is  greater  [than  30%]. 

I’m  OK;  you’re  OK, 
even  though  your  %RSDs  are  not  OK. 


7 


BUILDING  STRONG, 


Technical  Project  Planning  (TPP) 

•  7-Step  DQO  Process  implemented. 

►  H0:  p  >  Screening  Level  (SL) 

Reject  H0  (i.e.,  conclude  SU  “clean”)  if  95%  UCL  <  SL. 

Large  variability  (e.g.,  %RSD)  increases  UCL;  Rl  needed  if 
x  <  SL<  UCL  to  determine  if  the  site  is  “dirty.” 

Example:  Pb  for  MRS05,  SU5  -  Is  site  “dirty”  or  “clean”? 


LCL  x  =280  SL  =  400  UCL  =  460 
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Laboratory  IS  Sub-samples 


IS  Field  Replicates  (mg/kg)  Mean 

Metal  n  =  7  (MRS05,  SU#5)  (mg/kg)  %RSD 
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Sub-sampling  (within-sample)  Variability 


Metal 

Laboratory  Triplicate  Sub-samples 

Mean 

%RSD 

1st  Field  Replicate  (mg/kg) 

(mg/kg) 

Pb 

170  1,900  570 

880 

103 

Cu 

40  46  59 

48 

12 

Results  not  quantitatively  reliable; 

Pb  varies  by  order  of  magnitude  within  single  sample  ! 

aTotai  *  1 90  ppm  Total  variability,  n  =  1) 

<  aLab  «  940  ppm  (Lab  sub-sampling  variability,  n  =  3) ! 

•  crXotal  biased  low;  n  =  7  unground  field  replicates  too  small  to 
reliably  estimate  crXotal  and  do  statistical  evaluations. 
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Ground  vs.  Unground  Pb  (Same  IS) 
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Method  Blanks  (Ground  Glass) 
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Boxplot  of  Lead  Method  Blanks 


xG  =  9  ppm 
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Sample  Description 
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Ground  vs.  Unground  IS  Field  Replicates  for  Pb 


Boxplot  of  Pb,  Ground  vs.  Unground  n  =  7  Field  IS  Replicates 
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Mean  =  380 
%RSD  =  75% 


Mean  =  310 
%RSD  =  110% 


Ground 


UnGround 


Boxplot  of  Pb,  Skeet  Range  at  Fort  Eustis  ("DU  4") 


30000  - 

n  =  5  2.5-g  Ground  &  Unground 

1 
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Laboratory  Sub-samples 
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Boxplot  of  Pb,  Skeet  Range  at  Fort  Eustis  ("DU  4") 
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Conclusions 


•  %RSD  measures  variability  not  usability. 

►  Do  not  set  arbitrary  goals  for  %RSD.  Use  %RSD  to 
qualitatively  assess  precision  only. 

►  Use  7-Step  DQO  Process  to  develop  sampling  design 
and  evaluate  usability. 

•  Large  number  of  increments  of  limited  value  if 
lab  sub-sampling  variability  is  large  (because 
soils  with  metal  particles  are  not  ground). 

•  Even  IS  approach  with  grinding  may  not  be 
adequate  if  n  is  small. 
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Questions? 
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